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Abstract 

Background: This manuscript evaluates whether specific symptoms, a symptom index (SI), CA125 and HE4 can 
help identify women with malignant tumors in the group of women with adnexal masses previously diagnosed 
with ultrasound. 

Methods: This was a cross-sectional study with data collection between January 2010 and January 2012. We invited 
176 women with adnexal masses of suspected ovarian origin, attending the hospital of the Department of 
Obstetrics and Gynecology of the Unicamp School of Medicine. A control group of 1 50 healthy women was also 
enrolled. Symptoms were assessed with a questionnaire tested previously. Women with adnexal masses were 
interviewed before surgery to avoid recall bias. The Ward Agglomerative Method was used to define symptom 
clusters. Serum measurements of CA1 25 and HE4 were made. The Risk of Ovarian Malignancy Algorithm (ROMA) 
was calculated using standard formulae. 

Results: Sixty women had ovarian cancer and 1 16 benign ovarian tumors. Six symptom clusters were formed and 
three specific symptoms (back pain, leg swelling and able to feel abdominal mass) did not agglomerate. A 
symptom index (SI) using clusters abdomen, pain and eating was formed. The sensitivity of the SI in discriminating 
women with malignant from those with benign ovarian tumors was 78.3%, with a specificity of 60.3%. Positive SI 
was more frequent in women with malignant than in women with benign tumors (OR 5.5; 95% CI 2.7 to 1 1.3). 
Elevated CA125 (OR 1 1.8; 95% CI 5.6 to 24.6) or HE4 (OR 7.6; 95% CI 3.7 to 15.6) or positive ROMA (OR 9.5; 95% 
CI 4.4 to 20.3) were found in women with malignant tumors compared with women with benign tumors. The AUC- 
ROC for CA125 was not different from that for HE4 or ROMA. The best specificity and negative predictive values 
were obtained using CA125 in women with negative SI. 

Conclusion: Women diagnosed with an adnexal mass could benefit from a short enquiry about presence, 
frequency and onset of six symptoms, and CA125 measurements. Primary care physicians can be thereby assisted in 
deciding as to whether or not reference the woman to often busy, congested specialized oncology centers. 
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Background 

Each year, nearly 255.000 new cases of ovarian cancer 
are diagnosed. Ovarian cancers are the 7th most com- 
mon type of cancer in women, leading the mortality rate 
among gynecological cancers by causing 140.000 deaths 
per year [1]. The incidence of ovarian cancer is higher in 
industrialized countries, although developing countries, 
due to larger populations, hold the majority of cases 
(96.700 vs 107.500). In Latin America, the 8/100.000 in- 
cidence is close to that of developed countries, which is 
10/100.000 women. It was expected that 6.190 ovarian 
cancer cases would have been diagnosed in Brazil in 2012, 
with an estimated risk of 6:100.000 women. Not consider- 
ing non-melanoma skin cancer, ovarian cancer is the sev- 
enth most frequent cancer in Brazilian women [2]. 

In general, ovarian malignancies are diagnosed at an 
advanced stage, when symptoms are clearly present, or 
incidentally, at an earlier stage, when an ultrasound is 
made. It has long been demonstrated that long term sur- 
vival of ovarian cancer patients is better when these 
women are treated in specialized training centers, by gy- 
necologists with expertise in gynecologic oncology [3]. 
In Brazil, a substantial share of the patients is operated 
by 'semi-specialized' gynecologists without formal train- 
ing but with experience in oncology, generally in high- 
volume centers specialized in cancer. This professional 
is likely to be able to perform staging surgery for tumors 
apparently confined to the ovaries, and debulking sur- 
gery for advanced stage disease [3] . 

The preoperative assessment of an adnexal mass is dif- 
ficult, leading to a disproportionate number of women 
with benign ovarian tumors being referred to specialized 
centers and vice-versa, i.e., women with ovarian cancer 
being inappropriately operated in non-specialized cen- 
ters. In a systematic review, Geomini et al. [4] demon- 
strated that the Risk of Malignancy Indexes (RMI) I and 
II, which use the product of the serum CA125 level, an 
ultrasound scan result, and the menopausal state, were 
the best predictors of malignancy in the preoperative as- 
sessment of adnexal masses. Since 1999, the authors of 
the International Ovarian Tumor Analysis (IOTA) study 
have been analyzing a large cohort of patients with per- 
sistent adnexal masses, in different clinical centers using 
a standardized ultrasound protocol [5]. Their results 
consistently showed that using algorithms or even the 
application of simple and straightforward ultrasound 
classifications are the most accurate ways of identifying 
patients with malignant ovarian tumors [5,6]. These al- 
gorithms and simple rules have been extensively vali- 
dated [5,6]. In a recent study we tested the IOTA simple 
ultrasound rules [7] to identify malignant tumors in 
women with adnexal masses, resulting in a net sensitiv- 
ity of 90%, specificity of 87%, positive predictive value 
(PPV) of 69% and negative predictive value (NPV) of 



97% [7]. However, it must be emphasized that the high 
performance of IOTA-based ultrasound was obtained in 
the hands of examiners with high level of ultrasound ex- 
perience. These experienced examiners are more likely 
to be found in specialized centers. 

Recently, many studies examined whether symptoms 
could help in the selection of women at high risk of har- 
boring a malignant ovarian tumor. More than 90% of 
women with ovarian cancer report at least one symptom 
and these symptoms are most often the reason for the 
visit leading to the diagnosis. However, it remains un- 
known whether the evaluation of these symptoms is able 
to discriminate women with malignant ovarian tumors 
from women with benign adnexal masses [8]. It appears 
that women with ovarian cancer at any stage are more 
likely than their counterparts with ovarian benign 
masses to experience very frequent, sudden onset and 
persistent symptoms [8-11]. 

In parallel, CA125 serum measurements may also con- 
tribute to the identification of ovarian malignancies, al- 
though recent studies suggest that this contribution may 
be marginal [12,13]. For this reason, novel biomarkers 
that may help the differentiation of women with malig- 
nant tumors are currently under intensive scrutiny [14]. 
Moore and colleagues [15] have explored a large number 
of new biomarkers and recently the Food and Drug 
Administration approved HE4 and the Risk of Malig- 
nancy Algorithm (ROMA) for the diagnosis of ovarian 
cancer in woman with a clinically detectable ovarian 
mass. However, the diagnostic accuracy of HE4 and 
ROMA is still controversial. In a recent meta-analysis, Li 
et al. [14] concluded that although ROMA can help dis- 
tinguish epithelial ovarian cancer from benign pelvic 
masses, HE4 is not better than CA125 for ovarian cancer 
prediction. 

In the present study, we investigated whether the pre- 
operative evaluation of specific symptoms and tumor 
markers in Brazilian women with suspected adnexal 
masses previously diagnosed with ultrasound may help 
in the identification of the women who harbor a malig- 
nant ovarian tumor. We also evaluated the presence of 
these symptoms in a group of controls to assess the like- 
lihood of healthy women to experience symptoms asso- 
ciated with adnexal tumors. 

Methods 

Patient selection 

This was a cross-sectional study with prospective data 
collection. The study was approved by the institutional 
review board of the Unicamp School of Medicine (proto- 
col #1092/2009). An informed consent was obtained 
from all participants. Women with adnexal masses of 
suspected ovarian origin attending the hospital of the 
Department of Obstetrics and Gynecology of the 
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Unicamp School of Medicine were invited to enroll. A 
control group of healthy women attending menopause 
and family planning clinics at the same hospital was se- 
lected. As soon as surgery was indicated, women who 
had adnexal masses received an explanation about the 
study methods and purpose. Symptoms were assessed 
with a questionnaire previously tested and published by 
Goff et al. [9]. The questionnaire was applied to all 
women, in-person, by a trained professional (DRP). 
Women with adnexal masses were interviewed before 
surgery to avoid recall bias, since the main purpose of 
the study was to investigate whether symptoms could 
help to preoperatively discriminate women with malig- 
nant ovarian tumors. We also collected data on age and 
body mass index (BMI). Peripheral blood was collected 
for serum measurements of CA125 and HE4. The mean 
time elapsed from interview, blood collection to surgery 
ranged 24 h or less for emergency procedures to a max- 
imum of 120 days. Exclusion criteria comprised women 
who had already been operated for the adnexal mass and 
ongoing pregnancy. The final sample of this study 
consisted of 176 women with adnexal masses of ovarian 
origin and 150 healthy women. Patient accrual ranged 
January 2010 - January 2012, and collection of data re- 
garding the marker status and pathological diagnoses 
lasted through May 2012. 

Symptoms 

As previously stated, women with adnexal masses were 
surveyed prior to surgery, before they knew their histo- 
logical diagnosis. The survey evaluated the presence, fre- 
quency and duration of pelvic pain, abdominal pain, 
back pain, indigestion, being unable to eat normally, 
feeling full quickly, having nausea or vomiting, weight 
loss, abdominal bloating, increased abdomen size, being 
able to feel abdominal mass, urinary urgency, frequent 
urination, constipation, diarrhea, menstrual irregularity, 
bleeding after menopause, pain during intercourse, 
bleeding with intercourse, fatigue, leg swelling, and diffi- 
culty breathing. The survey was originally designed in 
English and was submitted to a Portuguese translation, 
which included two forward translations, one reconciled 
version and a back translation of the reconciled version. 
Initially, the patient was questioned about the presence 
or absence of a symptom. If present, the severity of each 
symptom along with its frequency and duration were 
evaluated. The frequency was reported with respect to 
the number of days per month, classified as: <1, 1-2, 3-6, 
7-12, 13-19 or >20 days/month. The duration was 
reported with respect to how long the symptom persisted. 
Next, the patient was asked during how many of the 
previous 12 months did the symptom occur, which 
was further categorized in <1, 1-2, 3-4, 5-6, 7-9, 10- 
12, >12 months. This symptom categorization emphasizes 



onset and frequency, since previous studies demonstrated 
that these two features are strongly related to malignancy 
[9,11]. We considered a symptom positive if it occurred 
more than 12 times per month, beginning in the last year, 
regardless of this severity [9,16]. 

Serum samples and marker assays 

Blood samples were collected from all patients and 
stored in Serum Separator Tubes (SST). They were 
allowed to clot for at least 30 minutes before centrifuga- 
tion. The blood samples were centrifuged 1300 g for 
10 min, and serum was aliquoted and stored at -80°C 
until analysis. Automated analysis of CA125 was 
performed by solid phase chemiluminescence using the 
OM-MA test (Siemens Medical Solutions Diagnostics, 
Tarrytown, USA) according to the manufacturer's in- 
structions and using their reagents and equipment. 
Values were expressed in units per milliliter (U/mL). We 
used the Immunochemiluminometric assay ([ICMA], 
Immulite* 2000 OM-MA, Siemens Medical Solutions 
Diagnostics) for CA125 measurements. The ROMA™ 
preconizes the use of the ARCHITECT CA125 IF" assay, 
which is a Chemiluminescent Microparticle Immuno- 
assay (CMIA), essentially the same technology as ICMA. 
According to Li et al. [14] CA125 tests with EIA 
(enzyme immunoassay) and RIA (radioimmunoassay) 
are considered "High Concern Regarding Applicability". 
CMIA and ICMA are thus equivalent technologies that 
can be used interchangeably. The level of serum HE4 
was determined using the HE4 enzyme immunometric 
assay Kits (EIA) (Fujirebio Diagnostics, Goteborg, 
Sweden) based on the direct sandwich technique, solid- 
phase immunoassay according to the manufacturer's in- 
structions and using their reagents and equipment. 
Values were expressed in picomoles per liter (pMol/L). 

Calculation of the Risk of Ovarian Malignancy Algorithm 
(ROMA) 

The Risk of Ovarian Malignancy Algorithm (ROMA™) 
uses the ABBOT ARCHITECT™ platform results for 
HE4 and CA125 to generate a predictive index (PI) for 
epithelial ovarian cancer, calculated by the formulae pro- 
posed by Moore et al. [15] for pre-menopausal and post- 
menopausal women. The manufacturer recommends the 
ROMA™ index to be used to stratify women into high- 
risk or low-risk groups of having epithelial ovarian 
cancer (EOC). We decided to use ROMA for the dis- 
crimination of women with ovarian malignancies, not 
only EOC. The ROMA™ risk estimation is based on the 
ABBOT ARCHITECT " platform; however, since we used 
the OM-MA test for CA125 (Siemens Medical Solutions 
Diagnostics, Tarrytown, USA) and the HE4 EIA Kit 
(Fujirebio Diagnostics), differences in assay methods and 
reagent specificity could lead to different performances. 
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Thus, we decided to use cutoff points based on the essay 
performance obtained with our sample (see statistics). 

Surgery and pathological assessment of tumor specimens 

Surgeries for diagnosis and/or treatment were performed 
at the hospital of the Department of Obstetrics and 
Gynecology of Unicamp School of Medicine and the 
techniques and surgical procedures were chosen and 
performed according to medical indication. All women 
with ovarian cancer were fully staged. The gold standard 
was the histopathologic diagnosis of surgical specimens, 
rendered by pathologists of the Department of Patho- 
logic Anatomy of the Unicamp School of Medicine, fol- 
lowing the guidelines of the World Health Organization 
International Classification of Ovarian Tumors [17]. For 
statistical purposes, the epithelial borderline tumors 
were classified as malignant (i.e. 10 out of 47 epithelial 
malignant tumors were rendered as borderline). 

Statistical analysis 

Data were entered into a Microsoft Excel (Microsoft 
Corp., Redmond, WA, USA) spreadsheet and analyzed 
with the R Environment for Statistical Computing Soft- 
ware" [18]. All statistical calculations were performed 
using 95% confidence intervals (CIs) and P <0.05 was 
considered significant. Women were classified into be- 
nign and malignant groups according to tumor histo- 
logic diagnoses. The sample size was calculated on the 
basis of the difference in symptom prevalence derived 
from previous studies [19,20], with 5% significance 
levels, 80% statistical power and 12% error limits for the 
sensitivity. Using these parameters, the minimal number 
of women with malignant tumors would be 54, and 
based on the prevalence of malignancy, 112 women with 
benign tumors would be needed for discrimination. 

Data analysis plan 

We first compared the main clinical features of the 
women in the three study groups using chi-squares, and 
the Kruskal-Wallis test for continuous numerical vari- 
ables such as age and BMI. Pairwise comparisons were 
done: women with malignant tumors vs. those with be- 
nign tumors; malignant vs. controls, and benign vs. con- 
trols. Next, using the pairwise groupings listed before, 
we compared the proportions of women presenting with 
each of the 22 specific symptoms. A dichotomous classi- 
fication for each symptom was used: positive if the 
symptoms had occurred more than 12 times, beginning 
in the last year, regardless of its severity; negative if 
otherwise. The proportions were pairwise compared 
using chi-squares or the Fisher exact test where appro- 
priate. Because the prevalence of symptoms was very 
low in control women, this group was excluded from the 
subsequent analyses (Table 1). 



Determination of symptom clusters 

The Ward's Hierarchical Clustering Method [21] was 
used to evaluate whether the specific symptoms could 
be clustered in women with malignant or benign ovarian 
tumors. The following specific symptoms were not in- 
cluded in the Ward's model: menstrual irregularity, 
bleeding after menopause, pain during intercourse, and 
bleeding with intercourse, because these symptoms de- 
pend on menopausal status and sexual activity; constipa- 
tion and diarrhea, because these symptoms appeared 
very rarely; and weight loss, because frequency could not 
be ascertained for that symptom. Thus, sixteen specific 
symptoms were entered into the Ward model. This 
method allows for the formation of statistically signifi- 
cant agglomerates of symptoms, which were depicted in 
the Euclidian plane (Figure 1): related symptoms appear 
close to each other; the closer they are, the more related 
to each other. We compared the prevalence of the symp- 
tom clusters and the remaining isolated symptoms in 
women with either malignant or benign tumors using 
crude (unadjusted) odds ratios and chi-squares/Fisher 
Exact test. We also calculated the performance indica- 
tors (sensitivity, specificity, with 95% confidence inter- 
vals, positive and negative predictive values - PPV and 
NPV) for each symptom cluster and isolated symptom 
in discriminating malignant from benign tumors. Goff 
et al. (2007) [9] proposed a "symptom index" (SI) that 
was most predictive of a women having ovarian cancer; 
the SI is considered positive if the women has at least 
one of the following symptom groupings: abdominal or 
pelvic pain, feeling full quickly or unable to eat normally, 
or increased abdomen size. Coincidentally, in our study, 
these symptoms formed identical clusters and were the 
most sensitive and prevalent. We thus decided to repli- 
cate Goff's SI in our study. 

Determination of CA 125, HE4 and the ROMA predictive 
index cutoff points 

We used standard receiver operator characteristics 
(ROC) analysis to determine the best CA125, HE4 and 
ROMA index cutoff points in discriminating benign 
from malignant ovarian tumors. In premenopausal 
women, the optimal cutoff points for CA125, HE4 and 
ROMA predictive index were, respectively, 69.8 U/L, 
41.6 pmol/L and 5.01%. In postmenopausal women these 
cutoff points were, respectively, 21.7 U/L, 96.6 pmol/L 
and 18.2%. ROC AUC comparisons were performed with 
the DeLong method [22]. 

Accuracy of symptom clusters, symptom index and tumor 
markers 

We performed pairwise comparisons of prevalence of 
the symptom clusters, symptom index, and the positivity 
rate of CA125, HE4 and ROMA index according to 
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Table 1 Specific symptoms in women with malignant or benign ovarian tumors and controls (healthy women) 




Malignant 
tumors 


Benign 
tumors 


Controls 


p- value 


p-value 


p-value 




(n 


= 60) 


(n = 


116) 


(150) 


(Malignant vs. benign) 


(Malignant vs. controls) 


(Benign vs. controls) 


Symptom 


N 


(%) 


n 


(%) 


n 


(%) 








Pelvic pain 


30 


(50.0) 


23 


(19.7) 


2 


(1.3) 


<0.01 


<0.01 


<0.01 


Abdominal pain 


23 


(38.3) 


10 


(8.5) 


0 




<0.01 


<0.01 


<0.01 


Back pain 


17 


(28.3) 


10 


(8.6) 


0 




<0.01 


<0.01 


<0.01 


Unable to eat normally 


22 


(36.7) 


8 


(6.8) 


1 


(0.7) 


<0.01 


<0.01 


0.01 


Feeling full quickly 


22 


(36.1) 


1 1 


(9.4) 


1 


(0.7) 


<0.01 


<0.01 


<0.01 


ndigestion 


15 


(24.6) 


/ 


(6.0) 


1 


(0.7) 


<0.01 


<0.01 


0.02 


Nausea or vomiting 


1 1 


(18.0) 


4 


(3.4) 


1 


(0.7) 


<0.01 


<0.01 


0.17 


Weight loss 


19 


(31.7) 


25 


(21.6) 


11 


(7.3) 


0.19 


<0.01 


<0.01 


Abdominal bloating 


36 


(60.0) 


32 


(27.4) 


0 


" 


<0.01 


<0.01 


<0.01 


ncreased abdomen size 


38 


(63.3) 


31 


(26.7) 


1 


(0.7) 


<0.01 


<0.01 


<0.01 


Able to feel abdominal mass 


14 


(23.3) 


11 


(9.4) 


0 




0.02 


<0.01 


<0.01 


Urinary urgency 


8 


(13.3) 


8 


(6.8) 


2 


(1.3) 


0.25 


<0.01 


0.02 


Frequent urination 


12 


(20.0) 


16 


(13.7) 


2 


(1.3) 


0.38 


<0.01 


<0.01 


Constipation 


2 


(3.3) 


2 


(1.7) 


0 




0.60 


0.08 


0.18 


Diarrhea 


3 


(5.1) 


1 


(0.9) 


0 




0.11 


0.02 


0.43 


Menstrual irregularities* 


1 


(1.6) 


1 


(0.9) 


1 


(0.7) 


1.0 


0.49 


1.0 


Bleeding after menopause** 


6 


(10.0) 


1 


(0.9) 


0 




<0.01 


<0.01 


0.43 


Pain during intercourse*** 


0 




0 




1 


(0.7) 


NC 


1.0 


1.0 


Bleeding with intercourse 


0 




0 




0 




NC 


NC 


NC 


Fatigue 


20 


(33.3) 


16 


(13.7) 


3 


(2.0) 


<0.01 


<0.01 


<0.01 


Leg swelling 


6 


(10.0) 


11 


(9.4) 


1 


(0.7) 


1.0 


<0.01 


<0.01 


Difficulty breathing 


9 


(15.0) 


5 


(4.3) 


2 


(1.3) 


0.02 


<0.01 


0.24 



*only for premenopausal women; **only for postmenopausal women; ***only for sexually active women; NC non-computabie. 
P-value: bivariate pairwise comparisons using chi-squares or the Fisher's exact test where appropriate. 



tumor malignancy and stage strata, using unadjusted 
odds ratios with 95% CI. Next, we calculated the per- 
formance indicators (sensitivity, specificity, with 95% 
confidence intervals, positive and negative predictive 
values) for the symptom clusters and tumor markers 
using standard formulae. 

Results 

Table 2 shows the comparison of key clinical features of 
women with malignant or benign ovarian tumors and 
controls. The mean age was significantly higher in 
women with malignant tumors. BMI was balanced be- 
tween the study groups. Epithelial benign and malignant 
tumors prevailed over the other histological types, but 
germ line (mature teratomas) and stromal tumors (fibro- 
mas) were also common in women with benign tumors. 
More than 50% of the women with malignant tumors 
had stage I disease. 

Women with malignant tumors showed a higher fre- 
quency of symptoms such as pelvic pain, abdominal 
pain, back pain, being unable to eat normally, feeling full 



quickly, indigestion, abdominal bloating, increased ab- 
dominal size, being able to feel abdominal mass and fa- 
tigue when compared with women with benign ovarian 
tumors. The prevalence of symptoms in control women 
was very low, with the exception of weight loss. This fact 
led us to exclude controls from the subsequent analyses 
(Table 1). 

Figure 1 shows the Euclidian representation of the 
Ward Agglomerative Method used to define the symp- 
tom clusters. This method was able to define 6 different 
clusters of symptoms. These clusters were named as fol- 
lows: abdomen (agglomeration of the following specific 
symptoms: abdominal bloating and/or increased abdom- 
inal size); pain (pelvic and/or abdominal pain); digestion 
(indigestion and/or nauseas/vomiting); eating (unable to 
eat normally and/or feeling full quickly); miscellaneous 
(fatigue and/or difficulty breathing) and bladder (urinary 
urgency and/or frequent urination). Three specific symp- 
toms (back pain, leg swelling and able to feel abdominal 
mass) did not agglomerate and remained as isolated 
symptoms. 
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Figure 1 Ward agglomerative method for hierarchical clustering. The following clusters of symptoms and isolated symptoms were defined 
by the Ward agglomerative method: abdomen (abdominal bloating and/or increased abdominal size); back pain; pain (pelvic and/or abdominal 
pain); leg swelling; eating (unable to eat normally and/or feeling full quickly); able to feel abdominal mass; miscellaneous (fatigue and/or difficulty 
breathing); digestion (indigestion and/or nauseas/vomiting); bladder (urinary urgency and/or frequent urination). 



Table 3 compares the prevalence of symptom clusters 
and isolated symptoms in women with benign or malig- 
nant ovarian tumors. Clusters and isolated symptoms 
were sorted according to decreasing prevalence in the 
studied population. With the exception of the cluster 
bladder and the isolated symptoms leg swelling, all 
symptoms were significantly more prevalent in women 
with malignant tumors. 

Table 4 compares the performance of the symptom clus- 
ters, isolated symptoms, and SI in discriminating women 
with malignant ovarian tumors from the others. Clusters 
and symptoms were ordered from the most to the least 
sensitive. Clusters abdomen, pain and eating were the 
most sensitive and those with the best PPV, and were 
therefore chosen to be used in the symptom index (SI) 
calculation. The sensitivity of the SI in discriminating 
women with malignant from those with benign ovarian 
tumors was 78.3%, with a specificity of 60.3%. 

In Table 5, we compared the prevalence of the three 
most sensitive symptom clusters, the SI, and the 



positivity rate of CA125, HE4, and ROMA predictive 
index across histological and stage strata. The percent- 
age of women with ovarian malignancy who experienced 
at least one cluster of symptoms ranged 37% to 72%, 
and this prevalence was not significantly associated with 
disease stage. The proportion of women with positive SI 
did not vary significantly across disease stage strata, with 
figures around 78%. The proportion of women with posi- 
tive SI was also significantly lower in women with benign 
tumors compared to women with stage I disease. Women 
with malignant tumors had significandy more elevated 
levels of the tumor markers compared to women with be- 
nign tumors. However, only 34% of the women with stage 
I disease had positive ROMA predictive index (PI), 
contrasted to 84% in women with advanced stage disease. 
It is worth noting, 40% of the women with benign tumors 
had positive SI, but only 12% of these women had positive 
ROMA PI. 

In Table 6 we evaluated the performance of the tumor 
markers in differentiating women with malignant tumors 
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Table 2 Key clinical features of women with ovarian malignant tumors, ovarian benign tumors and healthy women 
(controls) 

Characteristics Malignant Benign Controls p-value p-value p-value 

(n = 60) (n = 116) (n = 150) (Malignant vs. benign) (Malignant vs. controls) (Benign vs. controls) 



Age 

Years, mean (SD)* 
Menopausal status T 
Premenopausal 
Postmenopausa 
Body mass index (BMI) - 
Mean (+/- SD)* 
Histology 
Epithelial 

Invasive 
Borderline 

Germ line 

Sex cord and Stromal 

Non-neoplasic 

Stage 



50.8 (20.5) 

23 (383) 
38 (61.7) 
kg/m 2 

28.3 (+/-6.3) 

47 (78.3) 
37 (78.7) 
10 (21.3) 
6 (10.0) 
7(12.7) 



47.9 (16.6) 

68 (57.8) 
49 (42.2) 



44.4 (12.6) 

79 (52.6) 
71 (48.4) 



28.0 (+/-5.5) 27.2 (+/-5.0) 



40 (34.5) 



0.45 



<0.01 



0.42 



0.02 



0.05 



0.37 



0.18 



0.37 



040 



28 (24.1) 
20 (17.3) 
28 (24.1) 



32 (53.3) 

II 5 (8.3) 

III 22 (36.7) 

IV 1 (1.7) 

p values calculated with either chi-squares f or the Kruskal-Wallis test*. 

*2 ovarian carcinomas had endometrial carcinoma associated; for these cases ovarian carcinoma was considered the primary tumor. 



(or only women with stage I disease) from women with 
benign tumors in subsets of women with different symp- 
tom patterns. The AUC-ROC for CA125 was not signifi- 
cantly different from that for HE4 or ROMA in 
discriminating malignant (all stages) or only stage I tu- 
mors from benign tumors. The tumor markers yielded 
their best NPV and specificity in women with negative 
SI. Using the tumor markers in addition to the SI (the 
stand-alone performance of the SI is shown in Table 4) 



increases the specificity and the PPV of the differenti- 
ation strategy for malignant (all stages) from benign 
ovarian masses, but this does not hold true if we want to 
differentiate stage I disease from benign tumors. 

Discussion 

In this sample of Brazilian women who underwent sur- 
gery due to a suspected adnexal mass, the evaluation of 
specific symptoms proved to be a powerful tool for the 



Table 3 Prevalence of symptoms clusters/isolated symptoms according to tumor malignancy 



Symptoms 



Malignant positive N (%) 



Benign positive N (%) 



Crude odds ratio (95% CI) 



Cluster abdomen 


41 (68.3) 


36 (31.0) 


4.7 (2.4 to 9.3) 


<0.01 


Cluster pain 


33 (55.0) 


26 (22.4) 


4.2 (2.1 to 8.2) 


<0.01 


Cluster eating 


27 (45.0) 


14 (12.0) 


5.9 (2.8 to 12.6) 


<0.01 


Cluster miscellaneous 


21 (35.0) 


18 (15.4) 


2.9(1.4 to 6.0) 


0.01 


Cluster digestion 


1 8 (30.0) 


10 (8.5) 


4.5 (1.9 to 10.5) 


0.01 


Back Pain 


1 7 (28.3) 


10 (8.6) 


4.1 (1.8 to 9.8) 


<0.01 


Able to feel abdominal mass 


14 (23.3) 


11 (9.4) 


2.9 (1.2 to 6.8) 


0.02 


Cluster bladder 


14 (23.3) 


20 (17.1) 


14 (0.7 to 3.1) 


042 


Leg swelling 


6 (10.0) 


11 (9.4) 


1.1 (0.4 to 3.0) 


1.0 



Clusters of symptoms and isolated symptoms were defined by the Ward agglomerative method: abdomen (abdominal bloating and/or increased abdominal size,); 
pain (pelvic and/or abdominal pain); eating (unable to eat normally and/or feeling full quickly); miscellaneous (fatigue and/or difficulty breathing); digestion 
(indigestion and/or nauseas/vomiting); back pain; able to feel abdominal mass; bladder (urinary urgency and/or frequent urination), leg swelling. 
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Table 4 Performance of cluster of symptoms and the symptom index for the differentiation of women with malignant 
ovarian tumors from women with benign tumors 



Symptoms 


Sensitivity (%) (95% CI) 


Specificity (%) (95%) 


PPV (%) 


NPV(%) 


Cluster abdomen 


68.3 (59.9 to 63.1) 


69.0 (58.6 to 79.3) 


80.8 


53.2 


Cluster pain 


55.0 (45.0 to 64.0) 


77.8 (67.2 to 88.4) 


//.I 


55.0 


Cluster eating 


45.0 (36.0 to 54.0) 


88.0 (78.1 to 98.0) 


75.7 


65.8 


Cluster miscellaneous 


35.0 (26.3 to 43.6) 


84.6 (73.3 to 96.0) 


71.7 


53.8 


Cluster digestion 


29.5 (21.2 to 37.8) 


91.4 (81.1 to 100.0) 


71.3 


64.3 


Back Pain 


28.3 (20.1 to 36.5) 


91.4 (80.8 to 100) 


71.1 


63.0 


Able to feel abdominal mass 


23.3 (15.7 to 31.0) 


90.6 (79.1 to 100) 


69.7 


56.0 


Cluster bladder 


23.3 (15.7 to 31.0) 


82.9 (70.2 to 95.6) 


67.8 


41.2 


Leg swelling 


1 0.0 (4.6 to 1 5.4) 


90.6 (76.7 to 1 00) 


66.2 


35.3 


Symptom index (SI) 


78.3 (70.8 to 85.8) 


60.3 (5.4 to 70.3) 


50.5 


84.3 



Clusters of symptoms and isolated symptoms were defined by the Ward agglomerative method: abdomen (abdominal bloating and/or increased abdominal size); 
pain (pelvic and/or abdominal pain); eating (unable to eat normally and/or feeling full quickly); miscellaneous (fatigue and/or difficulty breathing); digestion 
(indigestion and/or nauseas/vomiting); back pain; able to feel abdominal mass; bladder (urinary urgency and/or frequent urination), leg swelling. Symptom index 
(SI) = presence of at least one of the symptoms included in the clusters abdomen, pain and/or eating. 



discrimination of malignant from benign ovarian tumors. 
The addition of CA125 to the SI increased the specificity 
and predictive values for the discrimination of malignant 
from benign ovarian tumors. This is especially important 
in a country where most women with adnexal masses 
have their condition detected with ultrasound in primary 
health care facilities. Symptom investigation, followed by 
CA125 serum level assessment is an affordable and 
straightforward approach to the initial triaging of women 
at elevated risk of harboring ovarian cancer. This ap- 
proach can yield a 63% probability that women referred 
to specialized centers (i.e., if one refers women with 
positive SI and elevated CA125) indeed have an ovarian 
malignancy. On the other hand, 90% of the women with 
an adnexal mass, negative SI and negative CA125 levels 
will ultimately be found to have a benign ovarian tumor. 



Our methodology to evaluate symptom cluster forma- 
tion yielded results that closely match Goff et al. recent 
results [11]. As they suggested, we can restrict the symp- 
tom questionnaire to a shortened version of six ques- 
tions encompassing the specific symptoms bloating, 
increased abdomen size, feeling full quickly, unable to 
eat normally and abdominal/pelvic pain. It is worth 
mentioning, however, that diagnostic models are known 
to deliver good results in the population at which they 
are first developed. But it must be emphasized that, rep- 
licating the methodology and using the same instrument 
that Goff et al. [9] used in their seminal studies, we 
obtained similar performance indicators for isolated 
symptoms and symptom clusters. Using the SI, Goff 
et al. [11] obtained an overall sensitivity and specificity 
of 70% and 86%, respectively, for the discrimination of 



Table 5 Prevalence of symptoms and tumor markers as related to tumor malignancy and stage 







Malignant 




Benign 




OR (95% CI) 






Stage 1 


Stage ll-IV 


All 


(n = 116) 


All malignant 


Stage 1 


Stage ll-IV 


Stage ll-IV 




(n = 32) 


(n = 28) 


(n = 60) 




vs. benign 


vs. benign 


vs. benign 


vs. stage 1 


Cluster 


% 


% 


% 


% 










Abdomen 


72 


64 


68 


31 


4.7 (2.4 to 9.4) 


5.7 (2.4 to 13.5) 


4.0 (1.7 to 9.5) 


0.7 (0.2 to 2.1) 


Pain 


44 


68 


55 


22 


4.2 (2.1 to 8.2) 


2.7 (1.6 to 6.1) 


7.3 (2.9 to 18.1) 


2.7 (0.9 to 7.8) 


Eating 


37 


5--1 


45 


12 


6.0 (2.8 to 1 2.7) 


4.4 (1.8 to 10.8) 


84 (3.3 to 21.3) 


1 .9 (0.7 to 5.4) 


Symptom index (SI) 


78 


79 


78 


40 


5.5 (2.7 to 11.3) 


5.4 (2.2 to 1 3.6) 


5.6 (2.1 to 14.8) 


1.0 (0.3 to 3.5) 


CA125 


4/ 


85 


65 


24 


5.7 (2.8 to 12.2) 


3.5 (1.5 to 9.2) 


18.4 (54 to 794) 


5.1 (1.3 to 25.1) 


HE4 


34 


86 


58 


15 


7.6 (3.7 to 1 5.6) 


2.8 (1.2 to 6.9) 


32.7 (10.1 to 105.4) 


114 (3.2 to 41 4) 


ROMA PI 


34 


82 


57 


12 


9.5 (4.4 to 20.3) 


3.8 (1.5 to 9.6) 


33.5 (11.0 to 102.4) 


8.7 (2.6 to 29.5) 



Symptom index (SI) = presence of at least one of the symptoms included in the clusters abdomen, pain and/or eating. 

Cutoff points in premenopausal women: CA1 25 = 69.8 U/ml, HE4 = 41 .6 pMol/L, ROMA predictive index (PI) = > 5.01 %. In postmenopausal women: CA1 25 = 21 .7 U/L, 
HE4 = 96.6 pMol/L, ROMA-PI > 1 8.2%. PPV positive predictive value, NPV negative predictive value. 
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Table 6 Performance comparison of tumor markers in subsets of women with adnexal tumors (benign or malignant) 
with different symptom patterns 



Group 


Marker 


ROC - AUC 


ROC-AUC comparison 
H E4 vs. CA 1 25 H E4 vs. ROMA CA 1 25 vs. ROMA 


Sensitivity (%) 
(95% CI) 


Specificity (%) 

(95%) 


PPV 

(%) 


NPV 

(%) 




For the differentiation between all malignant tumors from benign tumors (healthy women not included) 






All women 


CA 125 


0.81 (0.75 to 0.89) 




65.0 (56.3 to 73.7) 


75.9 (65.6 to 86.1) 


58.2 


80.7 




HE4 


0.74 (0.66 to 0.82) 


0.09 0.06 0.37 


58.3 (49.4 to 67.3) 


84.5 (74.7 to 94.2) 


66.0 


/9./ 




ROMA 


0.78 (0.71 to 0.86) 




56.7 (47.6 to 65.7) 


87.9 (78.7 to 97.1) 


70.8 


79.7 


SI Negative 


CA 125 


0.69 (0.52 to 0.86) 




46.1 (34.5 to 57.8) 


87.1 (70.2 to 100) 


40.0 


89.7 




HE4 


0.69 (0.54 to 0.84) 


0.98 0.45 0.67 


53.1 (42.2 to 65.5) 


84.3 (67.5 to 1 00) 


38.9 


90.1 




ROMA 


0.72 (0.57 to 0.87) 




38.5 (27.1 to 49.8) 


91.4 (74.9 to 100) 


45.0 


90.7 


SI Positive 


CA 125 


0.81 (0.73 to 0.90) 




70.2 (57.0 to 83.4) 


58.7 (45.3 to 72.1) 


63.5 


65.8 




HE4 


0.75 (0.65 to 0.85) 


0.27 0.25 0.52 


59.6 (45.4 to 73.8) 


84.8 (72.9 to 96.7) 


80.0 


67.2 




ROMA 


0.78 (0.69 to 0.88) 




61.7 (47.6 to 75.7) 


82.6 (70.4 to 94.2) 


78.4 


67.9 






For the differentiation between women with Stage 1 cancer from those with benign tumors 






All women 


CA 125 


0.73 (0.63 to 0.83) 




46.8 (37.8 to 56.0) 


75.9 (63.1 to 88.7) 


34.9 


83.8 




HE4 


0.61 (0.50 to 0.71) 


0.06 0.09 0.25 


34.4 (25.7 to 43.0) 


84.5 (71.3 to 97.7) 


37.9 


82.3 




ROMA 


0.66 (0.55 to 0.74) 




34.4 (25.7 to 43.0) 


87.9 (75.2 to 100) 


44.0 


82.9 


SI Negative 


CA 125 


0.52 (0.32 to 0.73) 




14.3 (6.1 to 22.5) 


87.1 (66.4 to 100) 


10.0 


91.0 




HE4 


0.60 (0.39 to 0.81) 


0.67 0.90 0.66 


28.6 (18.0 to 39.1) 


84.3 (69.5 to 1 00) 


15.4 


92.2 




ROMA 


0.61 (0.40 to 0.81) 




14.3 (6.1 to 22.5) 


91.4 (70.9 to 100) 


14.3 


91.4 


SI Positive 


CA 125 


0.75 (0.63 to 0.86) 




56.0 (41.7 to 70.3) 


58.7 (41.9 to 75.5) 


42.4 


71.0 




HE4 


0.58 (0.44 to 0.74) 


0.07 0.20 0.22 


36.0 (22.1 to 49.9) 


84.8 (67.2 to 1 00) 


56.2 


70.9 




ROMA 


0.65 (0.50 to 0.80) 




40.0 (25.8 to 54.2) 


82.6 (65.1 to 100) 


55.5 


71.7 



Symptom index (SI) positive = presence of at least one of the symptoms included in the clusters abdomen, pain and/or eating. Cutoff points for each tumor 
marker were obtained with ROC analysis. Cutoff points in premenopausal women: CA1 25 = 69.8 U/ml, HE4 = 41 .6 pMol/L, ROMA predictive index (PI) = > 5.01 %. 
In postmenopausal women: CA1 25 = 21 .7 U/L, HE4 = 96.6 pMol/L, ROMA-PI > 1 8.2%. PPV positive predictive value, NPV negative predictive value. 



women with ovarian cancer from healthy controls. We, 
on the other hand, used the SI in women already diag- 
nosed with an adnexal mass, and aimed at discriminat- 
ing those with a malignancy from the rest. In this 
context, we obtained a sensitivity of 78% and a specifi- 
city of 60%. In our study, the overall prevalence of can- 
cer was 34%, which implies that with a sensitivity of 78% 
using the SI as a standalone diagnostic tool, approxi- 
mately 50% of the women referred to a specialized cen- 
ter will ultimately have cancer. On the other hand, only 
15% of the women not referred will have cancer. By 
adding CA125 to the strategy, we may improve the posi- 
tive predictive value and further reduce the number of 
women erroneously referred to a specialized center, even 
if we want to refer women with early stage disease (see 
Tables 4 and 6). 

In the last decade, many studies addressed the symp- 
tom experience of women with ovarian cancer, and ovar- 
ian cancer can no longer be considered a disease that 
does not produce symptoms [9,16,23,24]. Women with 
ovarian cancer may experience various symptoms; how- 
ever, many of these symptoms have no relationship with 
the genital tract. Because these symptoms are unspecific, 



women and physicians tend to underestimate their im- 
portance. Women are often treated for irritable bowel 
syndrome, stress, depression or gastritis, months before 
they are diagnosed with ovarian cancer [11]. The under- 
rating of symptoms by women and doctors may contrib- 
ute to ovarian cancer not being timely referred to 
specialized centers. In our sample, all women with ma- 
lignancies reported some sort of symptom, which is con- 
sistent with data from other populations. 

The role to be played by HE4 and ROMA and their 
significance regarding changes in medical practice are 
still under debate [14,25]. Andersen et al. [16] in a pro- 
spective study comparing 74 women with ovarian cancer 
and 137 healthy women found out that either CA125 or 
HE4, when combined with the SI, detected 91.9% of the 
cases of malignancy. It is now clear that HE4 is essen- 
tially useful to distinguish epithelial ovarian cancer from 
other malignant ovarian tumors. Neither stromal nor 
germ cell tumors express HE4 and thereby are not dis- 
tinguishable from benign tumors by using HE4 [14,25]. 
We analyzed HE4 and ROMA considering all histologic 
types, because our objective was to identify women that 
would benefit from a referral to a specialized cancer 
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center. Our conclusion was that HE4 and ROMA did 
not facilitate the discrimination of malignant from be- 
nign ovarian tumors further than CA125 alone. 

Our data demonstrated that symptoms may be used 
even to differentiate women with early stage ovarian 
cancer from those with benign ovarian tumors. In the 
present study, 53% of the patients had stage I disease, re- 
gardless of the histological type of the tumor, and 78% of 
these had positive SI. Rossing et al. [26] demonstrated 
that the SI was positive in 62.3% of women with early 
stage disease and Goff et al. [27] obtained 57% sensitivity 
using the SI. However, in both studies, women were sur- 
veyed after diagnosis, whereas in our study we surveyed 
the women before surgery and thus before they were in- 
formed of the diagnosis of cancer. Because we aimed at 
identifying women who would benefit from a referral to 
a specialized center, we grouped together women with 
epithelial, germ cell and sex cord malignant tumors. On 
the other hand, we allocated to a same group women 
with borderline epithelial tumors and those with low- or 
high-grade invasive epithelial carcinomas. It is well 
known that these different histological types display 
varying clinical behaviors. Based on a dualistic model of 
carcinogenesis, epithelial ovarian carcinoma can be clas- 
sified as type I and type II. Type I included low-grade 
epithelial carcinomas, generally indolent and easily 
detected in stage I. Type II ovarian carcinoma, comprise 
high-grade and undifferentiated carcinomas [28]. It has 
been well demonstrated that high-grade serous tumors 
are rarely diagnosed before they had spread, and for this 
type of tumors, diagnostic approaches should be aimed 
at diagnosing low-volume tumors, not only tumors at an 
early stage [29,30]. 

Strengths and limitations 

The main strengths of this study are that we made 
all the interviews and tumor marker collection before 
surgery avoiding recall bias. All participants were in- 
terviewed in person with a standardized questionnaire. 
We also took care to assess symptoms in a relatively 
large cohort of healthy women that had attended family 
planning and menopause-related medical consultations 
at the same center. We found that these women have a 
very small likelihood of experiencing symptoms of re- 
cent onset and high frequency, which led us to safely 
remove these women from symptom performance calcu- 
lations. We must also mention that the questionnaire for 
the characterization of symptoms was used in Latin 
American women for the first time, and the results en- 
countered match those from studies addressing women 
from different cultural backgrounds [8,10,11]. 

As a detrimental point, our study suffers from verifica- 
tion bias, since we needed the final pathological diagno- 
ses for analyses and therefore only women who were 



operated for their adnexal masses had been evaluated. 
The performance of symptoms and serum markers was 
not evaluated in women who were not operated. An- 
other limitation of our study resides in the fact that we 
have not analyzed pre and postmenopausal women sep- 
arately. Of course, in our analyses, symptoms which ap- 
plied only to pre- or postmenopausal women and those 
applicable only to sexually active women were not in- 
cluded in the multivariate models. Unfortunately, this 
approach is not sufficient to rule out this selection bias 
because, for example, pelvic pain, which was significantly 
associated with malignancy, is frequently reported by 
young women with endometrioma [31,32]. As another 
weakness of the study, HE4 levels are known to be asso- 
ciated with BMI and age, but our analyses did not con- 
trol for these variables. 

Conclusion 

Neither symptoms nor CA125 can be safely used as 
standalone instruments to discriminate women with ma- 
lignant ovarian tumors from women with benign ad- 
nexal masses in lieu of a well performed ultrasound 
examination of the pelvis. However, in the foreseeable 
future, it is not realistic to expect that such a well 
performed ultrasound would be widely available in pri- 
mary care facilities, even if we consider that IOTA sim- 
ple rules can substantially increase overall ultrasound 
performance, at the same time simplifying sonographer 
training [5,7]. Collectively, our data indicate that asking 
a woman, who already had an adnexal mass incidentally 
detected in ultrasound, about the presence, frequency 
and onset of six symptoms and determining CA125 
levels can facilitate the decision making of primary care 
physicians as to whether or not reference the women to 
often busy, congested specialized oncology centers. 
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